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Abstract 

Hypothetical color-octet particles of spin 0, pair-produced at hadron colliders 
through their QCD coupling, may lead to final states involving three or four b jets. 
We analyze kinematic distributions of the 36 final state that differentiate the scalar 
octets from supersymmetric Higgs bosons. Studying the scalar sector that breaks 
an SU{3)xSU{3) gauge symmetry down to the QCD gauge group, we find that the 
scalar octet is resonantly produced in pairs via a spin-1 octet (coloron). A scalar 
octet of mass in the 140 - 150 GeV range can explain the nonstandard shape of the 
6-jet transverse energy distributions reported by the CDF Collaboration, especially 
when the coloron mass is slightly above twice the scalar mass. The dominant decay 
mode of the scalar octet is into a pair of gluons, so that the production of a pair of 
dijet resonances is large in this model, of about 40 pb at the Tevatron. Even when a 
W boson is radiated from the initial state, the inclusive cross section for producing 
a dijet resonance near the scalar octet mass remains sizable, around 0.15 pb. 



Contents 

1 Pairs of resonances 

2 Spin-0, weak-singlet, color-octet particle 3 

2.1 Renormalizable interactions Q 

2.2 Decays of the scalar octet 

2.3 CP violation in Bg mixing from scalar octet exchange 

1 



3 Tevatron phenomenology of scalar octets [10 

3.1 3b versus 46 signals [lO 

3.2 Properties of the 36 signal Il2 

3.3 Effects of boundstates [15 

3.4 Supersymmetric Higgs bosons [16 

4 Renormalizable Coloron Model 

4.1 Interactions and masses 

4.2 ReCoM and the CDF excess in the 36 final state H 

4.3 Dijet resonances plus a W boson and other signals [25 



5 Conclusions 



28 



1 Pairs of resonances 

Hadron colliders, such as the Tevatron and the LHC, allow the production at a high rate of 
new particles carrying QCD color. The subsequent decays of such particles often involve 
only QCD jets, which are hard to separate from the background. However, when the 
jets originate from 6-quark decays, the backgrounds are substantially reduced. Among 
the hypothetical particles leading to signatures involving several 6 jets are color-octet 
bosons. The simplest of those is the weak-singlet particle of spin 0, generically referred to 
here as the Gh scalar, which is present in various theories including Technicolor ("octet 
technipion" [1]), the 6D standard model (the Kaluza-Klein modes of the gluon polarized 
along extra dimensions |2]), vectorlike confinement weakly- interacting metastable pion 
models [4j, or certain supersymmetric models ("sgluons" [5J). The Gh scalar can be 
produced in pairs through its QCD couplings to gluons, and may decay through higher- 
dimensional operators into a pair of heavy quarks. The signature is four 6 jets, forming 
two 66 resonances of same mass [Gj [7] . 

Here we point out that an alternative way of searching for scalar octets is to require 
only three jets to pass the basic cuts and to be 6 tagged. We show that in this case 
the shapes of certain kinematic distributions may allow the separation of the signal from 
the background, and the differentiation between various extensions of the standard model. 
For example, compared to the Minimal Supersymmetric Standard Model (MSSM) at large 
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tan /3, where a Higgs boson is produced in association with a b quark and then decays 
to a bb pair, the octet pair production leads to a peak at a larger invariant mass of the 
leading and third jets. 

Even more dramatic deformations of the distributions occur when the pair of Gh 
scalars is produced through an s-channel resonance. We study these effects within a 
renormalizable theory that includes an extension of the QCD gauge group, SU{3) x 
SU{3), as proposed in |8| |9]. The scalar sector responsible for spontaneously breaking 
this symmetry down to SU{3)c includes a Gh scalar as well as two gauge singlet real 
scalar fields. We refer to this as the Renormalizable Coloron Model (ReCoM). The heavy 
gauge boson arising from the extended symmetry, labelled by G'^ and referred to as the 
coloron (or more generally gluon-prime) , is a color-octet particle of spin 1. 

We show that the coloron couples to a pair of Gh scalars so that s-channel production 
of G'^ leads to a 46 signal. This is an example of nested resonances [lOj: two pairs of b 
jets form each a resonance and the combination of the two pairs also forms a resonance. 
These multiple resonant features allow an efficient rejection of the background. However, 
for that it is necessary to have four 6-tagged jets, which requires large data sets. If only 
three 6-tagged jets are required to pass the cuts, then the signal is larger and a detailed 
analysis could separate it from the background within smaller data sets. 

The CDF Collaboration has searched for a resonance in the invariant mass distribution 
of the two leading b jets, produced in association with a third b jet. Preliminary results 
[TT] suggest the existence of a resonance with mass of about 140 GeV, that could be 
attributed to a fluctuation of the standard model background at the 6% confidence level. 
A more puzzling feature of these CDF results is that the measured transverse energy 
(Et) distributions of the b jets have shapes that differ notably from the standard model 
predictions [1^. The shapes of the Et distributions of the two leading b jets may be due to 
a fiuctuation of the standard model only at around 1% confidence level. We demonstrate 
that these shapes are nicely explained within the ReCoM when the Gh mass is 140 GeV 
and the G'^ mass is slightly above the GhGh threshold. 

We describe the interactions and decays of the spin-0 octet in Section O Then we 
analyze the Tevatron phenomenology of QCD-produced Gh pairs in Section [31 There we 
also discuss the boundstate effects due to gluon exchange between the two Gh produced, 
and we compare the kinematic distributions of the multi-6-jet final state due to the scalar 
octet with those due to supersymmetric Higgs bosons. In Section |4] we derive the ReCoM 
predictions, compare them with the CDF data for several 36 kinematic distributions, and 
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discuss implications for other final states, such as those arising from associated production 
of a coloron and a W boson. We summarize strategies to distinguish different models with 
multi b jets in Section |5l 



2 Spin-0, weak-singlet, color-octet particle 

The theory considered in this section is the standard model plus only one particle, Gh, 
which is a real field of spin 0, transforming as an octet under the QCD gauge group SU{3)c 
and as a singlet under the electroweak gauge group SU {2)w x f/(l)y . These gauge charges 
imply that Gh is electrically neutral, and does not have any renormalizable interactions 
with the quarks and leptons (note that GnbLbR is not invariant under 5'[/(2)iy; the 
opposite is true in the case of weak-doublet scalar octets [TBI El)- We refer to Gh as a 
scalar octet, independently of whether it is a composite (as in technicolor) or elementary 
particle. 

2.1 Renormalizable interactions 

The renormalizable couplings of Gh to gluons are fixed by SU{3)c gauge invariance: 

f abc fade Qb^Q^dQC^Qe^ + Qs G^G^^ Q^G'h , (2.1) 

where f°'^'^ is the anti-symmetric SU{?>)c tensor, Qs is the QCD coupling, and G^ is the 
gluon field. The only other renormalizable couplings of Gh are to the Higgs doublet {H) 
and to itself: 

— 1^ gIjGIjH'^h + {gIjGIjY + dahc gIjG^ijGIj , (2.2) 

where \hg and Ac > are dimensionless parameters, is a parameter of mass dimension 
one, and dabc is the totally-symmetric SU{?>)c tensor. 

The first term in Eq. (12. 2p contributes to the mass squared of Gh after electroweak 
symmetry breaking. We take the sum {Mq^) of this contribution and the mass squared 
from the Lagrangian to be positive. As a result, Gh does not have a vacuum expectation 
value (VEV) provided there is an upper limit on the cubic coupling, Ificl ^ \^XgMgh- 
We are primarily interested in the case where the physical mass of Gh, Mgjj, is above 
around 100 GeV. 
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Figure 1: GhGh production in hadronic collisions (-u-cliannel Gh exchange is not shown) 
Curly lines represent gluons, while dashed lines represent scalar octets. 
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Figure 2: Scalar octet decay to gluons, due to the trilinear Gh interaction of Eq. fl2.2p . 
A diagram similar with the left one but with interchanged end points for the gluon lines 
is not shown. 



The production of Gh at hadron colliders occurs mainly in pairs, due to the couplings 
( 12. ip to gluons, via the tree-level diagrams shown in Fig. [T] Single Gh production is 
possible at one-loop through a cubic interaction [the last term in Eq. fl2.2p ]. but it is 
suppressed enough to be neglected. 



2.2 Decays of the scalar octet 

The only renormalizable coupling of Gh that violates the Z2 invariance under the Gh — ^ 
—Gh transformation is the cubic term in Eq. ( 12. 2p . Thus, the only decays of Gh allowed 
by the renormalizable couplings shown above occur at one or more loops and involve at 
least one vertex proportional to /i^. At one-loop, divergent terms from the triangle and 
bubble diagrams shown in Fig. |5] cancel each other, and the finite result for the width of 
Gh decaying into two gluons is 

To{Gh ^ 99) = J^4^ f- - iT ^ (2-3) 
ov H yyj 128 TC^Moa V 9 / 

where as is the QCD coupling evaluated at M^^. This width is accidentally suppressed 
by the small numerical coefficient given in the paranthesis (see [H] for a similar case). 

Decays of Gh into quarks induced by nonrenormalizable couplings may have large 
branching fractions because the above decay width into gluons is loop-suppressed. Dimension- 
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5 operators of this type involve either a Higgs doublet, 

^i/G?,QiTX + ^i/G^OiTV^ + H.c. , (2.4) 

or a covariant derivative, 

^ (irg Inl'T^d^R + IfnY^'n + Qh'T^Qi) D.G^h + H.c. , (2.5) 

where = {u\,d\), the indices z,j = 1,2,3 label the generations, Cf-^ and Kfp'^ 
are complex coefficients, and is the mass of a heavy particle which generates these 
operators (if several particles of different masses contribute to these operators, then their 
effects can be included in the coefficients). Note that the derivative parts of operators (12.51) 
may be transformed into the operators (12. 4p . with the Higgs field replaced by its VEV, 
through integration by parts and the use of quark field equations. The non-derivative parts 
of the three operators only mediate 3-body decays, which are less important compared to 
the 2-body decays. 

There are also dimension-5 operators contributing to the Gh — > gg decay. 



a. 



da,, G^H G\, [ic G^^^ + e^^-^G^^) , (2.6) 



and to the Gu — ^ gZ or g^ decays. 



-^^^^—G^^Gl,[iBB^^ ^^^e^^-f^B^f,) . (2.7) 
47r cos t^VF "T-v 

Here, B^y is the field tensor of the f/(l)y gauge boson {— ^m.dy/Z^ + co^d-^A^, where 
is the photon field) and Qw is the weak mixing angle. These operators are generated 
by loops involving some new particle of mass whose coupling to Gu determines the 
dimensionless coefficients ^q-, ■Cg' and The decay of a scalar octet into a gluon and 
a photon has been studied in Ref. |15] . 

Operators that allow Gu to decay into a Higgs boson and gluons arise at dimension-7 
or higher. For example, the operator {D^G'\^G°^^yH'^D^H induces the Gu ggh decay 
(the Gu gh process is forbidden by angular momentum conservation). The opera- 
tors that couple Gu to leptons also appear only at dimension-7 or higher, for example, 
{D^^G^^)UrL^Gl,. 

Given that the operators (12.41) involve the Higgs doublet, their coefficients are typi- 
cally proportional to the quark mass. It is natural to assume that the dominant decay 
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Figure 3: Effective couplings of a scalar octet to b quarks and the Higgs VEV (left 
diagram) , or to a gluon pair (right diagram) , induced in the presence of a heavy vectorlike 
quark ip and leading to the Gh bb, gg, g'j, gZ decays. 

mode induced by operators (12. 4 p is Gh tt for Mg^ ^ 350 GeV, and Gh -> hb for 10 
GeV < ~ 350 GeV. However, the relative normalization of the Cf^ and C^^ coeffi- 

cients depends on the underlying mechanism responsible for generating these operators. 

To be concrete, we consider the following renormalizable model as an origin for the 
dimension-5 operators. A vectorlike quark, ip, having the same gauge charges as b^ may 
mix with the down-type quarks via the following terms in the Lagrangian: 

+ l^i^i^hdR + VijH'^Ld^R + XiHQ'^ipR + H.c. , (2.8) 

where i/ij and Aj are Yukawa couplings, /ij^ is a mass mixing parameter, and is the ip 
fermion mass in the small /ij^ limit. The scalar octet also has Yukawa couplings to ip: 

GIj (r/o i^LT^i^R + m ^lT^Vr) + H.c. (2.9) 

The above interactions lead to effective couplings of Gh to standard model quarks, as 
shown in the first diagram of Fig. |3l Upon integrating ip out, the operators (12. 4p are 
induced with coefficients 

Gr,=0 , Cf^^Kv* , (2.10) 

where we assumed for simplicity that ^ fii^. The coefficients Gfj are defined in 
the gauge eigenstate basis. Assuming that the two unitary matrices that diagonalize 
the down-type quark mass matrix are close to the identity matrix, the Gh couplings 
to down-type quarks in the mass eigenstate basis are approximately equal to Gfj. For 
I A3 1 ^ |Ai|, IA2I and jr/sl ^ |?7i|, |?72| the width for Gh — ?• bb is much larger than for any 
other fermion final states, and is given by 

r (Gh "5) - , (2.11) 
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where v = 246 GeV is the electroweak scale. 

The ip fermion also induces some of the dimension-5 operators given in Eqs. fl2.6p and 
(12. 7p . as shown in Fig. [31 The ensuing decay width into gluons, which adds to Tq given 
in Eq. is 

rv,(G„^gg)^ ^^;^;^3°| |^(A4„/(4m^))r . (2.12) 

where the function A arises from a momentum integral given in [T6] : 

2 

A(x) = — \x + (x - l)Arcsin^yi; 1 , for x < 1 . (2.13) 

X'^ 

For X 1, i.e. ^ Mg'^/2, the function has the value A 4/3, and the coefficients 
of the operators (12. 6p are 

, . (2.14) 

The ratio of the decay widths into bb and gg, neglecting the interference of the two 
diagrams contributing to Gh — ^ gg in Figures |2] and [3l is given by 

r {GH^bb) 0^69 f \hV3\ 100 GeV 0.1^ ^ 



T^Gh^ gg) + Fo {Gh^ gg) vl + 3.02 /i^mJ/M^^ V 10-=^ Mg„ as 

(2.15) 

Note that may be significantly above the TeV scale, so that the vectorlike quark might 
not be produced even at the LHC Thus, the branching fraction of Gh — ?■ bb can be very 
small if fiGf^ip ^ Mgh- Alternatively, if ip is not much heavier than Gh, and rjo = 0(1), 
then the branching fraction of Gh — ?• bb can be large only for {Xsrj^l ^ 10^^. 

The scalar octet has a very narrow width (several orders of magnitude less than its 
mass), as its contributions arise from loops or higher dimensional operators. Its decays 
are usually prompt, unless ^g is very small and is very large. For example, /ig = 0, 
?7o = and m^/lX^risl > 2.5 x 10^ TeV give a decay length cr ^ 100 fiui so that Gh 
decays off the beam line. We will not investigate further these signatures involving dijet 
and bb resonances originating from displaced vertices. 

The decays Gh gi-, gZ have small branching fractions due to coupling and color sup- 
pressions [the coefficients of the operators (12.71) are comparable with those in Eq. (12. 14^ : 
is = and = 0]. For example, 

F {Gh gi) a 



V (r ^ \ 1. - • (2.16) 

T^{Gh ^ gg) I5as 

Nevertheless, a photon-plus-jet resonance that arises together with a dijet resonance of 
equal mass, is an interesting signature that follows from the decays of a Gh pair. 
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2.3 CP violation in Bs mixing from scalar octet exchange 



The operators f l2.4p can induce tree-level flavor-changing neutral-current (FCNC) pro- 
cesses mediated by the scalar octet. In particular, integrating out the octet gives the 
following AB = 2 terms in the effective Lagrangian: 

2 

2AP W3KbLT''sn + V2>^3bnT^s,Y , (2.17) 

where the quark fields shown here are mass eigenstates, and r/^ and are the Yukawa 
couplings of Eqs. (12. 8p and (12. 9 p transformed to the mass eigenstate basis. 

Tree-level exchange of octet bosons has been proposed before [TT] as a possible explana- 
tion for the anomalous dimuon charge asymmetry reported by the DO Collaboration |18j . 
The novel feature in our case is that the scalar octet has dimension-5 couplings to the 
standard model quarks. Nevertheless, we now show that the effect of Gh is large enough 
if the Gh mass is below a few hundred GeV. 

Using the relation T^jT^i = —Si^i/G + ^i^jf^, and substituting the matrix elements 
of the ensuing operators from Ref. [19], we find the matrix element of the Hamiltonian 
associated with operator (I2.17P : 



(^.1^^^^.) = .../^""M^^ ^. \{W2Kr + (^^a;.)^) (bs + Ib^ 



96 M^^m^{mb + nisy 



+ HXW2KiB,-B,) . (2.18 



The decay constant, computed on the lattice with 2+1 fiavors [20], is fs^ = 231 ±15 MeV. 
The "bag" parameters have been estimated on the lattice in the quenched approximation 
[19]: B2 = 0.80, B3 = 0.93, B^ = 1.16 and B5 = 1.75. 

If ri'^X2 or r/gAg have complex phases, then the Gh exchange induces CP violation in 
Bg — Bg mixing. Parametrizing 

^ {CB^e-'^' - 1) 2MBAMl^r (2.19) 

where Mff ~ (9.0 ± 1.4) ps"^ [2ll [17], and using Eq. (I2.18P we find that the vectorlike 
quark mass required to induce the CP-violating phase 0^ is 



V fsMT 2.3 MX'^f + {v^X'.f] + 2Ai,X',i2X', 



SMa^imb + m,) (3Mff )'/' {Cl^ + 1 - 2Cb, cos0,) 



1/4 



(2.20) 
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The measured Bg mass difference gives the constraint Cb^ = 0.98 ± 0.15, and the DO 
dimuon asymmetry requires 0^ near — 7r/2. For illustration, let us assume 773 = ^'2^3: 
= ^ and 0s = — vr/2, which gives 

,„,«l.lTevM^i2^ . (2.21) 
♦ 10-2 Mc„ ^ ' 

Thus, for I773A2I = |'72A3| ~ 10~^, the DO dimuon asymmetry suggests that the vectorlike 
quark has a mass within the reach of the LHC 



3 Tevatron phenomenology of scalar octets 

Scalar octets are produced in pairs at hadron colliders (see Fig. [1]) and decay with a large 
branching fraction into bb. The partonic cross sections are given by [71 [13]. 

aigq-^GnGH) = , (3-1) 



a{gg GhGh) 



27/3-17/3^ + 3(/3^ + 2/3^-3)ln 

32 s 



(3.2) 



where /3 = (1 — AMq^ / sY/'^ is the velocity of the octet in the center of mass frame. Thus, 
the signal consists of a pair of narrow bb resonances of same mass, Mq^. Including the 
interactions (12.21) into the MadGraph/MadEvent [22] package, we find that the processes 
shown in Fig.[Tl convoluted with the CTEQ 6L1 [23] parton distribution functions (PDFs), 
give the cross section for pp — GhGh at the Tevatron shown by the solid line in Fig. |H 
The factorization and renormalization scales used by default in MadGraph/MadEvent are 
equal and depend on the event: (M^^ + p^(G'i))^/^(M^^ + ^^(^2))^/^, where Pt{Gi) and 
Pt{G2) are the transverse momenta of the two Gh produced in each event. This cross 
section depends only on Mg„, and is consistent with the result shown in Fig. 3 of Ref. [6]. 



3.1 36 versus 46 signals 

The QCD background is dramatically reduced by selecting events containg four jets, all 
b tagged, and then imposing that two of them have an invariant mass close to that of the 
other two b jets [6]. We point out, however, that the sensitivity to the pair of octets could 
be improved if, instead of requiring four b jets, only the three jets of largest transverse 
momenta are b tagged and required to pass the basic cuts. In this case only two of the b 
jets will form a resonance, and therefore the background is substantially higher than in 
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Figure 4: Leading-order cross section for production of a Gh pair (solid line) at the 
Tevatron. Also shown are the cross sections after cuts for producing a pair of Gh followed 
by each decaying with 100% branching fraction into hh and requiring that 3 (dashed line) 
or 4 (dotted line) jets pass the cuts and are 6-tagged. 

the case of a pair of resonances of same mass. However, the signal is also larger, such 
that the ratio S/ \fB where S and B are the number of signal and background events, 
respectively, may be increased. 

To see this, first note that the h tagging efficiency is about 50%, leading to a factor 
of 2 suppression of the 46 signal compared to the 36 signal. The 46 signal is further 
suppressed because the 4th jet is rather soft, especially for low M^^, and does not always 
pass the basic cuts, such as px > 20 GeV, imposed by the CDF [TT] and DO [27] searches. 
To estimate the ensuing suppression of the 46 signal, we use MadGraph/MadEvents to 
generate parton-level events at tree level for pp — )■ GhGh — ?• 6666 at a center-of-mass 
energy of 1.96 TeV. Imposing the basic cuts used by CDF [11], namely px > 20 GeV and 
\ri\ < 2 for each 6 jet, we obtain the result shown in columns 2 and 3 of Table 1. 

Initial and final state radiation further soften the 4th jet. We estimate this effect 
by processing the parton-level events with Pythia [24j for showering and hadronization, 
and PCS ^26j (with the default CDF detector card) for detector simulation. The result 
is shown in columns 4 and 5 of Table 1. The 6-tagging efficiency also decreases for softer 
jets, so that the efficiency for four 6 jets to pass the basic cuts is significantly smaller than 
that for three 6 jets, especially for low Mg^ (see the last column of Table 1). In Fig. HI 
we show the signal cross sections for 3 and 4 6-tagged jets after basic kinematic cuts. 
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3.2 Properties of the 36 signal 



Given that the 3b signal is larger than the 46 signal by a factor ranging between 9 and 
5 when Mgjj varies between 100 and 350 GeV (see last two columns of Table [1]), it is 
useful to focus on the 36 final state and analyze its special features, which may be used 
for reducing the background. The most clear feature of this signal is that two of the three 
b jets form a narrow resonance of mass close to Mg„- Let us label the three b jets by 6j, 
z = 1, 2, 3. Within each event we take 6i, 62, 63 to be the jets of largest, 2nd-largest and 
3rd-largest transverse momenta (pt), respectively. In the limit where Mgjj is very large, 
close to ■\/i/2, the two octets are produced mostly at rest and the px of a jet is fixed by 
the angle between the two b jets from the decay of an octet such that bi and 62 form a 
mass peak. 

For masses of interest at the Tevatron, between 100 and 400 GeV, the pt's of the octets 
are comparable with the p-r's of the jets in the rest frame of the corresponding octet. As a 
result, the mass peak is formed in some events by bi and 62 while in other events by 61 and 
63, or even by the 62 and 63 jets. We refer to these three types of events as (61, 62)5 (^i, ^3), 
and (62, 63) respectively. To estimate the ratios between the numbers of events falling into 
these three categories, we impose an invariant mass cut \mij — Mgh\ < 0.2Mg^, where 
rriij = m{bi, bj) is the invariant mass of the bi and bj jets. We show the efficiency of the 
combination of basic and invariant mass cuts in Fig. |5l Given that the (61, 62) and (61, 63) 
events have comparable efficiencies, it is useful to use both rriu and mi3 as discriminants 
between the octet signal and the QCD background. Note that the ratio of the efficiencies 
for (61,62) and (61,63) events increases with M^^, which is explained by the large 
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18.1 
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87.8 


19.9 


3.8 
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98.9 


86.7 


99.4 


90.6 


20.0 


4.2 



Table 1: Efficiency in % for the three and four jets to pass the basic cuts {pr > 20 
GeV, \ri\ < 2): at parton level (columns 2,3), after radiation and detector effects included 
through Pythia and PGS (columns 4,5), and after 6 tagging by PGS (columns 6,7). 
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Figure 5: Fraction of signal events having the invariant mass of the ith and jth jets, 
rriij = m{bi, bj), within 20% of the octet mass Mgh- The fractions for combinations with 
the 4th jet are below 1% and are not shown here. 



argument presented above. 

So far there have been no collider searches for the pair-produced octet. However, the 
CDF and DO Collaborations have searched for a 36 signal predicted in the MSSM at large 
tan/3: a h quark from the proton (in the 5-flavor PDF scheme) radiates off a heavy Higgs 
boson which then decays into a hh pair. This is the same final state as the 36 one due to 
octets discussed here, but we will show that the kinematic distributions are different. 

The CDF search [11], with 2.2 fb~^ of data, shows an intriguing excess of events with 
mi2 in the 125-155 GeV range. The probablity for this excess to arise from a fluctuation 
of the standard model background is 0.9%, and increases to 5.7% when the whole range 
of invariant masses is taken into account. 

The DO search [27J, with 5.2 fb^^ of data, rules out the presence of MSSM Higgs bosons 
with couplings large enough to account for the CDF excess. The tension between the 
CDF and DO results may be due to a statistical fluctuation. An alternative explanation, 
however, is that the DO search is less sensitive to the octet-induced signal; this is a 
consequence of the optimization of the signal within the DO search for the MSSM Higgs 
bosons through the use of a likelihood discriminant. Some of the kinematic variables 
included in the likelihood discriminant {e.g., the angular separation A0 between the two 
6 jets that are most likely to originate from the decay of the new particle) may discriminate 
against events due to GhGh production. 
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Figure 6: Kinematic distributions resulting from GhGh production at the Tevatron due 
to gluon couplings, for an octet mass of 140 GeV (cross section is 4.6 pb) and a Gh bb 
branching fraction of 60%. Left panel: invariant mass distributions of the two leading b 
jets (dotted red hne), and of the 1st and 3rd leading b jets (solid blue line). Right panel: 
transverse energy distributions of the 1st (dashed black hne) and 2nd (solid purple line) 
leading 6 jets. 



Motivated by the CDF search, we first study the kinematics of an octet having a mass 
Mcjf = 140 GeV, and impose the basic cuts pt > 20 GeV and \ri\ < 2 for each b jet. In 
Fig. El left panel, we show the number of events as a function of invariant masses of bi 
and 62 ("^12)5 and of 61 and 63 (mis). Although the peak of the distribution is close to 
Mg^, the spectrum is broad such that our mass window cut \m{bi, 62) — \ < O-'^Mq^ 
keeps only around 50% of signal events. The mi3 distribution also shows a clear peak, 
which is narrower than the mu one. The mi3 peak is at a lower invariant mass than 
the peak, because radiation effects make the 3rd jet softer. The transverse energy 
distributions of the two leading jets (see the right panel of Fig. [6]) also have clear peaks. 
However, those peaks appear to be too broad to provide a convincing explanation for the 
excess of the leading two jet transverse energy distributions at CDF fT2]. We return to 
this issue in Section 4.2. 

To study the octet discovery limit at the Tevatron, we impose high pj- cuts on the 
three leading b jets, of 150, 120, and 100 GeV, respectively. For Mg^ = 300 GeV, the 
signal is simulated to have an acceptance around 3%. Further imposing the invariant 
mass cut |m(6i,62) — ^GhI < 0.271/^-^, there are approximate 6 signal events for 20 fb~^ 
with approximately zero background. Therefore, using only the three leading b jets, we 
estimate that the Tevatron can discover this octet particle up to a mass of ~ 300 GeV. 
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3.3 Effects of boundstates 



Since the octet is much heavier than the QCD confinement scale, the QCD interaction 
approximately generates an attractive Coulomb-like potential between two octets. We 
anticipate various boundstates named octonium from two octets. From group theory, 
there are only three attractive channels: 1, 8a (antisymmetric) and 8s (symmetric) from 
8 ® 8, because they have positive differences of the quadratic Casimir between the initial 
and the final states. Defining Cf = [6*2(8) + 6*2(8) — C2(/)]/2, we have Ci = 3 and 
= =3/2. The potential from the one-gluon exchange is 

V^r>^-C,^, (3.3) 

where is evaluated at the energy scale of the Bohr radius of the boundstate. In this 
paper, we will evaluate the QCD coupling running only at one loop. The gauge coupling 
in terms of the Bohr radius is given by 

a, ^{Mz) - Ooln [rMz) 
Here, 60 = (H^^'c - 2iV/)/(67r) with Nf = 5 for < 1/r < nit. 

We solve the Schrodinger equation numerically for the potential (13. 3 p using the above 
running gauge coupling. The Bohr radius is tq ^ 0.07 GeV~^, the binding energy is 
Ei,{8) ~ 2.0 GeV and the wavefunction squared at the origin is |'?/^8(0)P ~ (9.2 GeV)^. 
To compare with the pure Coulomb potential, we fix the gauge coupling to be ^^(l/ro) 
and find = Cj al{l/ro) Mg^/A = 2.2 GeV and |V'(0)|2 = Cj a^{l/ro) MI;^/{8tt) ^ 
(12.4 GeV)'^. So, the effects of these two potentials differ by about 10%. In following, we 
will use the more precise running potential. We also report the binding energy and wave- 
function squared for the singlet channel as Eb{l) ^ 6.5 GeV and |'?/'i(0)p ~ (16.9 GeV)^. 

In our calculation of the boundstate wavefunction and the binding energy, we have 
neglected the width of the constituents. If the octet width is much larger than the binding 
energy [as is the case for m^/IAsr/sl ~ 100 GeV in Eq. (12. lip ], the boundstate's effects on 
the octet production can be neglected. 

For a narrower octet, with T{Gh) ^ Eb, we neglect the width of the constituents. The 
S-wave boundstates of two scalar fields have the quantum numbers, J^'-^ , of 0"^^ for the 
singlet, 0+^ for 8a and 0++ for 83. Their couplings to the quarks should be suppressed by 
the quark mass because of the chirality, so the dominant production cross section should 
be from gluons at colliders. Since the production cross section is related to the decaying 
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widths via the Breit-Wigner formula, we first calculate the decaying widths of those three 
boundstates to gg and 26 + 26. The falling apart width is r4;, 2Tg- The decay widths 
of the boundstate Bf to two gluons are calculated using the non-relativistic relation at 
the low-velocity limit, r(i3/ -> X) = vaiGnGH ^ X)\ip{0)\'^, as 



ni^ss)-'-^§^\Mm\ r(8.^9j) = ^^|p^l*.(o)P. (3.5) 

G G 

where the mass of the boundstate is Mbj = '2.Mgh — Eb{f). Note that 8^ does not 
decay into two gluons. For M^^ = 150 GeV, we have r(l — )• gg) ^ 0.04 GeV and 
r(8s ^ gg) ^ 0.002 GeV. 

In the narrow width approximation, we have the following partonic production cross 
section of those boundstates 

7T^r{l^gg) 2^ ^ 7r2r(8s^^^) ^ fo a\ 

(Tgg^lis) = ^JJ-^ S{S - MgJ , (Tgg^Ssis) = S{s - MgJ .(3.6) 

Using the gluon PDF, we obtain the production cross section at the Tevatron with ^/s = 
Ecu = 1.96 TeV 



aipp^Bf)= / —fg{x)fg 



X s 



(3.7) 



For Mg„ = 150 GeV, using the Mathematica MSTW 2008 PDFs [29], the resonance 
production cross sections are a{pp — ?■ 1) ~ 190 fb and a{pp — )■ 8s) ~ 57 fb, which is a 
few percent of the octet pair production cross section and can be neglected in the collider 
searches. 



3.4 Super symmetric Higgs bosons 

Let us now compare the kinematic distributions of the multi-6-jet final states arising from 
scalar octet production with those due to the Higgs bosons of the MSSM. In Two-Higgs- 
doublet models, such as the Higgs sector of the MSSM, there are two color-singlet and 
electrically- neutral spin-0 particles (the heavy Higgs bosons and ^4°) that may have 
large couplings to the 6 quark. In the 5-flavor PDF scheme, where the proton includes a 
6-quark, the emission of a heavy Higgs boson from a 6 quark line leads to a 36 final state 
(see diagram next to Table 2). Equivalently, in the 4-fiavor PDF scheme, where there 
is no 6 inside the proton, production of a 66 pair followed by emission of a heavy Higgs 
boson gives four 6 jets that may appear as a 36 final state when one of the jets does not 



16 



M (GeV) 


150 200 250 300 350 




158 Ififi 1Q7 1Q1 91 




4.3 6.1 7.4 7.7 7.7 


Gh 


1.0 1.0 0.86 0.79 0.73 




0.50 0.25 0.16 0.10 0.10 




Table 2: Ratio (in %) of the numbers of events with 46 or 36, for the MSSM (representative 
process shown on the right-hand side) at tan /3 = 40 (3rd row) and QCD GhGh production 
(2nd row). Also, the ratio of numbers of events that pass the mi2 or mi3 invariant-mass 
window cut, \mij — Mg^I < 0.2Mg'^, for the MSSM (5th row) and for the octet (4th row). 



pass the cuts. At large tan /3 and for ^ Mz, the production cross sections of and 
are approximately equal, and are related to the standard model Higgs production by 
a{bbH^) = a{bbA^) = tan^ P a{bbhlu) M- 

In order to study the multi-6 Higgs signal, we impose the same cuts as in the case of 
scalar octets: px > 20 GeV and \ri\ < 2 for each b jet. Compared to the octet case, fewer 
events pass these cuts because one of the jets does not arise from the decay of a heavy 
particle. For example, the fourth b jet has ~3 times smaller chance to pass the basic cuts 
than in the octet case (see rows 2 and 3 of Table |2]). The invariant mass of the leading 
and the third jets is also less likely to be within the mass window |my — M^^l < 0.2Mg'^ 
than in the octet case (see last two rows of Table [2]). Thus, the mi3 distribution is a 
good discriminant between the octet and the MSSM Higgs bosons, especially when the 
resonance is heavy. We show the invariant mass distributions for the 61,62 and 61,63 jet 
pair in Fig. [7] for heavy Higgs bosons of mass 140 GeV and a leading-order production 
cross section (summed over A^ and H^) corresponding to tan /3 = 40. Comparing Figs. [7] 
and O we can see that the MSSM Higgs bosons lead to an mi3 distribution with a peak 
that is both lower and located at a smaller value than the peak due to the scalar octet. 

If a large excess of events over the standard model background will be established in 
the 36 final state, then an MSSM interpretation will typically require an excess of events 
in the br^r^ final state due to the decays of and A^ into tau leptons. By contrast, Gh 
can not decay into leptons-only final states because it is a color octet, so that no 6r+r~ 
excess is predicted in the octet models. 
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Figure 7: Same as Fig.|6l but for MSSM Higgs production at tan /3 = 40 (the leading-order 
production cross section is around 5.4 pb). 



4 Renormalizable Coloron Model 

Let us now analyze a minimal renormalizable model that includes a spin-1 color-octet 
particle [H [9], called "coloron". We will show that this model includes a scalar octet, 
identical with the Gh studied in sections [2] and [3] except that here it can be resonantly 
produced in pairs, through an s-channel coloron, G'^. The gauge symmetry of this model is 
an extension of QCD, S'f/(3)i x SU{?>)2- This symmetry is spontaneously broken down to 
the QCD gauge group SU{'i)c by the VEV of a complex scalar field, S, which transforms 
as (3,3) under SU{'i)i x 5t/(3)2. 

4.1 Interactions and masses 

The most general renormalizable potential of S is 

K(S) = -ml Tr(SEt) - ^ (det E + H.c.) + ^ [Tr (SSt)] ^ + ^ Tr (EE^EE^) , (4.1) 

where without loss of generality we take /i > 0. Note that the second term above is 
5'f/(3)i X SU{?))2 invariant because it can be written as 

detE = ^e*^'^e^'^''='E,,,E,yEfcfc, . (4.2) 

We assume m| > so that E acquires a VEV: 



(S) = = V4(K + 3A)m| + /.^ + ;. 

^ ^ x/6 2(fi:-f3A) ^ ' 



where I3 is the unit 3x3 matrix. The potential is bounded from below provided 3X+k > 0. 

Expanding S around this vacuum, we find that its 18 degrees of freedom (S is a 
3x3 complex matrix) are grouped into four real scalar fields: two octets {Gfj and Gq, 
a = 1, 8) and two singlets {(pR and (pj) under SU{3)c, 

S = i=(/s + + ^ h + (G?, + z G^) T« . (4.4) 

Gq are the Nambu-Goldstone bosons associated with the broken generators of SU{3)i x 
311(3)2, and become the longitudinal degrees of freedom of the coloron. Previous studies 
of this model have assumed that the other degrees of freedom of S are heavy enough 
to be neg lectecfl. It turns out, however, that within a renormalizable model valid for a 
range of scales above /s, the G^, (pR and 0/ scalars are lighter than the coloron. Thus, 
it is interesting to study their properties. We refer to the renormalizable model that 
includes all the scalar particles contained in S and the SU {3)i x SU {3)2 gauge symmetry 
as ReCoM. 

For — )■ 0, there is a f/(l)i x f/(l)2 global symmetry broken by (S) down to the 
diagonal U (1) subgroup, and the associated Nambu-Goldstone boson is 0/, which becomes 
massless. For any /i, the squared mass of 0/ is given by 

Ml = ^-Hh . (4.5) 

For K — )■ and /i — )■ the potential (14. ip has a global 5*0(18) symmetry, which is 
spontaneously broken by the S VEV down to 5*0(17), so that Gh and (pi are massless 
Nambu-Goldstone bosons. Hence, the quartic term in V"(S) proportional to A does not 
contribute to the Gh mass. For any k and /i, the squared mass of Gh is 

M'^^=^-{2Ml + ^ft) . (4.6) 

The mass of (pn also follows from Eq. (14. ip : 

Ml = l[{K + 3X)f^-Ml] . (4.7) 

Eq. (gJl) implies /s > \/Qfi/{K + 3A), so that M^^ > 0. 

The kinetic term of S, normalized such that all its component fields shown in Eq. (14. 4p 
have canonical kinetic terms, is given by 

Tr D^J:) , (4.8) 

-^An exception is the 5*^7(3)1 x SU{3)2 linear cr-model description of heavy-light mesons in QCD [5T] . 
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where the SU{3)i x SU{3)2 covariant derivative is 

D'^S = a'^E-i/iiG^''T'^S + z/i2GTST" . (4.9) 

The kinetic term leads to a mass-square matrix for the two gauge fields, G'^"' and C^"", 
proportional to /|. Upon diagonalization, one linear combination becomes the massless 
QCD gluon, 

G"^ = cos0G^ + sin^G'^ , (4.10) 
while the orthogonal linear combination is a massive spin-1 octet, the coloron: 

G"'^ = sin^G'^-cos^G^ . (4.11) 

The mixing angle depends only on the SU{3)i x SU{3)2 gauge couplings, hi and 
tan 9 = hi/h2. The QCD gauge coupling is given by gs = hi cos 9 = h2 sin 9, and the mass 
of the coloron is 

Mg' = h. (4.12) 

y3sin2^ ^ ^ 

This mass is larger than the VEV /s if tan^ ^ 0.65. For tan^ ^ 1 and A, k ^ 0{1), 

the coloron is heavier than the scalars. For example, the set of parameters 

tan^ = 0.12 , /s = 75GeV , = 275 GeV , k = \ = lA , (4.13) 

and asiMc) ~ 0.1 gives the following mass spectrum: 

Mg' ^ 290 GeV , Mg^ ^ 140 GeV , M^, ^ 159 GeV , M^^ ^ 46 GeV . (4.14) 

Substituting the decomposition of S, Eq. (14. 4p . into the kinetic term (14. Sp . we find the 
following interactions of a coloron and two scalars: 

(079''G^ - G^S'^^/) + r''^ G'" . (4.15) 



v^sin2^ ' " ' tan 2^ 

These interactions induce G' decays into scalars with tree-level widths (in the case where 
the two-body decays are kinematically open) given by: 

r(G' ^ Gh 0/) = MgAi- 2 + ^ . (4.16) 

^ ^ ^ ' 18sin2 2^ \^ Ml, M^, J ^ ^ 
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If all standard model quarks belong to the fundamental representation of SU (3)i, then 
G' couples to them as 

gsia-ne-qYT^G'^^q . (4.17) 
The width of the coloron decay into quark pairs is 

r(G; ^qq) = ^tan'e Ma> (l - ' , (4.18) 

where we have not summed over quark flavors. The kinematic suppression in the last 
factor is relevant for G'^ — )■ tt, if Mq' > 2mt. The coloron effects on top-quark physics are 
rather sensitive to new quarks that mix with the top [32] and to the top charges under 
SU{3)i X SU{3)2 [8J. 

QCD corrections to the above decay widths may be large, perhaps of the order of 50%, 
but computing them is beyond the scope of this paper. Assuming that the QCD correc- 
tions to G'^ — )■ Gh Gh and G'^ qq decays are of the same size, the parameters given in 
Eq. (I4.13P lead to branching fractions of 61% and 39% for GhGh and jj, respectively. 

4.2 ReCoM and the CDF excess in the 36 final state 

The total width of G'^ is rather small, typically less than one percent of its mass for 
tan^ ^ 0.3 and for a G'^ mass not more than a few percent above the GhGh and Gh4>i 
thresholds. We can then use the narrow width approximation to estimate the cross section 
for producing a G'^ in the s-channel: 

aiqq ^ G') ^ ^^^^ S (V§ - Mcj . (4.19) 

Convoluting this partonic cross section with the MSTW [29] PDFs, and then multiplying 
by the branching fractions derived from Eqs. fl4.16p and fl4.18p we find the total cross 
sections shown in Fig. [HI The QCD corrections to these processes are also likely to be 
sizable, and need to be computed in the future. 

The process pp — )■ G'^ — )■ jj is constrained by the CDF search for dijet resonances 
[33] : for Mq' ~ 290 GeV, the limit on the cross section times acceptance is about 100 pb. 
Given that the G'^ production is proportional to tan^ 6, Fig. [8] indicates that the CDF 
limit implies tan 6' ^ 0.2 for a Gh mass of 140 GeV. 

The decays of Gh into bb or gg proceed through higher-dimensional operators, similar 
to the case discussed in Section [2j For example, a vector like down- type quark ip, which 
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transforms as a triplet under SU{3)2, couples to E and a b quark: 

r/3E6H^L + H.c. (4.20) 

Integrating out ip we obtain at tree level the first operator of Eq. (12.51) . which mediates 
the Gh — bb decay, suppressed by two powers of the 773 coupling. A 1-loop diagram as 
in Fig. [3] leads to Gh 99- This decay also occurs at one loop independently of ip, as 
shown in Fig. |2l due to the det S term from Eq. (14. ip . 

Compared to the QCD pair production of two Gh scalars, the kinematic distributions 
of b jets arising from G' — t- GhGh — ?■ 46 (see diagram in Fig. ^ are changed dramatically. 
Especially when the mass of G' is close to twice of the Gh mass, those two G^'s are 
mainly produced at rest and the jet Et distributions are more peaked, as can be seen 
by comparing the right-hand panels of Figs. E] and dOl As shown in Fig. |H1 the resonant 
production of a Gh pair is an order of magnitude larger than the QCD GhGh cross 
section (of about 4.6 pb for Mq^ = 140 GeV, as can be seen in Fig. H]). Hence, a smaller 
branching fraction (around 20%) of Gh — ?■ bb gives a number of 46 events comparable to 
that due to the supersymmetric Higgs bosons for a mass of 140 GeV and tan /3 = 40. 

The CDF 36 search [TT] shows an excess in the rriu distribution, as mentioned in 
Section 3.2, and in addition the shapes of the Et distributions of the 6 jets are shifted 




0' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ' — ^ 

0.10 0.12 0.14 0.16 0.18 0.20 

tan 9 



Figure 8: Production cross section of G'^ at the Tevatron times branching fractions, 
computed in the narrow width approximation and at leading order. The cross section for 
— )■ — )■ GhGh is given by the solid (red) line, and that for pp ^ G'^ ^ jj by the 
dotted (blue) line. The masses are taken to be 140 GeV for Gh and 290 GeV for and 
the decay G'^ — )■ Gh (pi is assumed to be kinematically forbidden. 
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Figure 9: Coloron (G^) resonance decaying to a pair of scalar octets (Gh), each giving 
rise to a bb resonance. 
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Figure 10: Same as Fig. |6l but for resonant GhGh production via G' and a Gh — ?■ bb 
branching fraction of 20%. The production cross section of pp ^ G' ^ GhGh is 40 pb 
for = 140 GeV, = 290 GeV and tan^ = 0.12. 



towards larger values compared to the standard model background [12]. The dotted 
(blue) line in Fig. [TT] shows the background from the best CDF fit to the data, and the 
shown data points include only statistical errors. The 40 — 50 GeV bin of the leading- 
jet Et distribution is about 3.5a below the background, suggesting that the background 
normalization is too high. The 70 — 80 GeV bin is about 2.5cr above the potentially 
overestimated background, suggesting the presence of some new heavy particles which 
produce hard b jets. The Et distribution of the second jet has similar features. 

In our ReCoM there are four parameters relevant for fitting the CDF invariant mass 
and jet Et distributions: the G'^ and Gh masses, the mixing angle 6 and the branching 
fraction of Gh bb. Since the peaks of the Et distributions of the two leading b jets 
match the excess bins (70 — 80 GeV for the first jet and 50 — 60 GeV for the second jet, see 
Fig. E]), we fix the masses of G'^ and Gh to be 290 GeV and 140 GeV, respectively (nearby 
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Figure 11: Comparison of the signal-plus-background distributions with CDF data [T2] . 
The solid (red) line is a combination of the background (multiplied by 0.93) from CDF 
and both the resonant (via a G'^) and QCD production of two Gh scalars. The branching 
fraction of Gh — ^ bb is taken to be 22% as a result of fitting to the mi2 and Et distributions 
of the two leading jets. The dotted (blue) line, taken from [T2], is the CDF background- 
only fit to the data. The black points are CDF data with only statistic error bars. The 
G' mass is chosen to be 290 GeV and the Gh mass is 140 GeV. 



values with similar splitting, such as 305 GeV and 150 GeV, work equally well). Fig. |H] 
shows that the production cross section is insensitive to tan 6' for 0.1 < tan 6' < 0.2; for 
illustration, we fix tan 6' = 0.12. Taking into account the unknown overall normalization 
of the background, we fit the rriu (first 10 bins) and Et (first 9 bins for each of the 
two leading jets) distributions reported by CDF [12]. The total reaches the minimum 
for the background normalization factor of 0.93 and B{Gh — ?• l>b) = 22%. The P^r 
degree of freedom is 0.75 {p-valne of 82%) from our signal-plus-background fit, while the 
background-only fit has x^/dof = 1.74 (p-value of 1%). In our simple fit we have not 
included systematic errors, and we have not allowed different normalization factors for 
different components of the background. Nevertheless, this successful fit indicates that it 
would be important for the CDF and DO Collaborations to compare their multi-6 data 
with the ReCoM predictions. 

The fitted Gh — > bb branching fraction implies that the Gh — ?■ gg branching fraction 
is large, around 78%. Thus, ReCoM predicts that the number of bbjj events with equal 
bb and jj invariant masses is about 7 times larger than the number of 46 events satisfying 
the similar equal-mass condition. Another prediction is that the invariant mass of the 
four jets has a peak close to the coloron mass of 290 GeV. 
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4.3 Dijet resonances plus a W boson and other signals 



Another test of our ReCoM is associated production of G'^ with weak gauge bosons. 
Feynman diagrams for producing G'^ plus are shown in Fig. [121 We find that the 
partonic cross section for this process is 



where 



Snaag tan^ 6 
9P siia^Ow 



s^ + {Ml, + Ml,Y^Js-Ml,-M'^ + M^ 



Ml, 



2Mg'Mi 



w 



■Mi 



.21) 



Mi 



{s - Ml, - M^Y - AMl.M'y 



1/2 



(4.22) 



The leading-order cross section for the pp — > G' W process at the Tevatron, computed 



using MadGraph, is shown in Fig. 
290 GeV. 



for tan^ = 0.12, and is around 150 fb for Mq' 



Since the coloron can cascade decay into four jets via two Gh scalars, or directly 
decay into two jets, it is useful to analyze the invariant mass distribution of the two 
leading jets in the final states that include a W decaying to Iv, with i = e, fi. Following 
the CDF search in this channel [3l], we impose the pT(jets)> 15 GeV, Pt{£) > 20 GeV, 
pT > 25 GeV cuts on the signal events, using the MadGraph/MadEvents to Pythia to 
PGS chain as in Section 3. For the signal events from G'^ — > GhGh 4:j, the acceptance 
for passing those cuts is around 63% for inclusive 2 jets or 3 jets in the final state. For 
the signal events from G'^ — )■ 2j, the acceptances are around 59% for inclusive 2-jet events 
and 28% for inclusive 3-jet events. 

In Fig. [131 we show the invariant mass distributions of a pair of jets in the multi- 
jet-plus-£z/ events resulting from a simulation of the ReCoM signal. As expected, the 
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Figure 12: Representative diagrams for W boson production in association with a coloron 
(G^) decaying to a pair of scalar octets (Gh), each giving rise to a dijet resonance. 
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Figure 13: Leading-order production cross section (solid black line) of G'^ in association 
with a W boson at the Tevatron for tan 6' = 0.12. The cross section times the coloron 
branching fraction is shown for the G'^ decay into a pair of jets (dotted line), and into 
GhGh (solid red line). 



invariant mass of the two leading jets (^12) has two peaks corresponding roughly to the 
masses of Gh and G^, chosen to be 140 GeV and 290 GeV, respectively. The height of 
the first peak is relatively insensitive to tan 6', since a{pp — )■ G'^W) x B(G'^ GhGh) 
is fairly constant for a range of tan 6' values, which is similar to the case of single G'^ 
production shown by the solid (red) line in Fig. |8l The height of the second peak is 
strongly sensitive to tan^; especially for small values of tan^, the cross section times the 
B{G'^ — 7- 2j) branching fraction is proportional to tan'^6'. 

The invariant mass of the leading and third jets (^13) has a single peak (see the dashed 
line in Fig. [14]), near the Gh mass, because the direct G'^ — )■ 2j decay does not contribute 
at leading order to this distribution. The peak in mis is a distinctive feature of ReCoM, 
allowing to differentiate it from the low-scale technicolor model [35] that also predicts 
final states involving a dijet resonance and a W boson. Even more dramatic would be the 
observation of two different dijet resonances of equal mass in association with a W, as 
shown in Fig. [TH but in that case it is likely that a computation of next-to-leading order 
effects is necessary, in order to include the case where an extra jet is radiated with a pt 
larger than that of the third or fourth jet originating from Gh decays. 

G'^ production in association with a Z boson or photon may also be interesting. For 
example, Z-plus-jets events at the LHC, with the leading jets forming a resonance and 
the Z decaying into charged leptons, could allow a sufficient separation of the ReCoM 
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niij (GeV) 

Figure 14: Invariant mass distributions for the two leading jets (mi2, solid line) and for 
the first and third jet (mi3, dashed line), in events arising from G'^ + W production at the 
Tevatron. All coloron decay channels and only the W — )■ eu, fiu decays are included. The 
first peak is mostly due to the G'^ — )■ GhGh 4:j decay (its location is sensitive only to 
the Gh mass), while the second peak in mi2 is due to the direct G'^ — )■ 2j decay. The 
branching fractions for those two channels are 61% and 39%, respectively, for Mq^ = 140 
GeV, Mg' = 290 GeV and tan^ = 0.12. A slightly larger G'^ mass increases the first 
peak, and a larger tan 6' increases the second peak. 

signal from the large standard model background. 

Throughout this section we have assumed for simplicity that (pj is too heavy to be 
produced in coloron decays. However, for a range of ReCoM parameters [see Eqs. (14. 5 p 
and (14. 6p ] 0/ is lighter than Gh so that G'^ — )■ Gh4>i is the dominant decay mode of the 
coloron. In that larger coloron production cross section {i.e., a larger tan 6') is 

allowed by the dijet searches because the branching fraction for G'^ — )■ qq is suppressed. If 
0/ decays predominantly into hght jets, than the G'^ — Gh(Pi decay contributes to the 4j 
and W + 4j signals (increasing the height of the first peak in Fig. [T^ without necessarily 
affecting the multi-6 signal. 
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5 Conclusions 



Four-jet final states at the Tevatron and the LHC are predicted in various theories for 
physics beyond the standard modeL Even though the QCD background is very large, the 
presence of invariant mass peaks allows the separation of the signal from the background 
O E]. When the new particles decaying into jets have spin 0, it is natural to expect 
that a significant fraction of the jets comes from b quarks because the spin-0 couplings to 
standard model fermions are typically proportional to mass. Thus, 6-tagging can further 
decrease the background. 

In this paper we have investigated the properties of weak-singlet, color-octet scalars 
("scalar octets"). Electroweak gauge invariance prevents these scalars from coupling at 
renormalizable level to standard model fermions, but dimension-5 couplings to quarks 
are allowed and lead to decays mostly into bb and gluon pairs. The exchange of a scalar 
octet of mass below a few hundred GeV could lead to large CP violation in Bg mixing, 
as indicated by the DO dimuon asymmetry (see section 2.3), if a vectorlike quark that 
induces the dimension-5 couplings has mass below the TeV scale. 

The scalar octets are pair produced through their coupling to gluons, which is fixed by 
QCD gauge invariance, or via an s-channel resonance due to a spin-1 color-octet particle. 
We have shown that the simplest gauge invariant origin of such a resonance, namely the 
renormalizable version ("ReCoM") of the coloron model based on the SU{3)i x SU{3)2 
gauge extension of QCD [SI [9] , automatically includes a large coupling of a coloron to a 
pair of scalar octets. The parameters in this model that affect the 46 signal are the ratio 
tan 6* of gauge couplings, which controls both the production and branching fractions of 
the coloron, the masses of the coloron and scalar octet, and the branching fraction of the 
scalar octet into bb. We have focused on the case where only three b jets pass some basic 
cuts, so that a large part of the signal is preserved, at the expense of not being able to 
reduce the background as efficiently as when both bb are present. 

Both DO and CDF have searched for 36 final states present in the MSSM at large 
tan p. The DO search involves a likelihood discriminant which is optimized for the MSSM 
topology, and therefore cannot be applied to our 36 signal. The CDF preliminary result 
in the 36 final state, using the invariant mass distribution rriu of the two leading jets, has 
some excess of events consistent with a new particle of mass in the 140 — 150 GeV range 
and decaying to 66. The background normalizations are taken as free parameters, and are 
fitted so that the deviation in rriu is minimized. However, the shapes of transverse energy 
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distributions of the leading and second jets do not fit well the standard model background 
[T2] . We have shown here that the ReCoM changes the shapes of these distributions such 
that they agree well with the data (see Fig. 11). The best fit of the ReCoM to the CDF 
preliminary results indicates that the branching fraction of the scalar octet into two gluons 
is approximately 3 times larger than the branching ratio into bb. 

Perhaps this good fit is only an accident, and the background modeling performed by 
CDF can be modified such that the standard model fit to the data improves. Nevertheless, 
the success of the ReCoM in describing the CDF data is intriguing enough to warrant 
its experimental study. Specifically, the CDF Collaboration could fit the background 
plus the ReCoM signal to the 36 data for the mi2, Eti and Et2 distributions. The DO 
Collaboration could use the scalar octet kinematics to define the likelihood discriminant 
and to check whether the ReCoM is consistent with their observables. Both collaborations 
could look for a 46 signal exhibiting a pair of resonances of equal mass. They could also 
search for the bbjj signal from two resonances as a further test of the ReCoM. 

The cross section for coloron production is large enough so that even the process where 
a W boson is radiated from the initial state (see Fig. 12), which has smaller backgrounds, 
leads to a sufficient number of events to be tested at the Tevatron. The signatures include 
a W decaying leptonically and four jets, with the invariant mass distribution for two jets 
peaking at the same location as for the other two jets, near the scalar octet mass of 
140 — 150 GeV. When the two leading jets come from the same scalar octet, the signature 
is a W boson plus a dijet resonance, which may explain an excess in the CDF data from 
an inclusive search in this channel [31]. ReCoM predicts the presence of a second mass 
peak of the two leading jets, due to the direct decay of the coloron into quarks (see Fig. 
14). 

The ATLAS and CMS experiments can search for scalar octets with masses between a 
few hundred GeV and a couple of TeV, impresively extending the Tevatron reach. In the 
case of a scalar octet with mass of about 140 — 150 GeV, relevant for the CDF excess, it 
is hard to overcome the QCD background at the LHC, so that the Tevatron experiments 
should attempt to discover or rule out its existence. 
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